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We present a stability analysis of the two-dimensional t — t' Hubbard model for various values of 
the next-nearest-neighbor hopping t' , and electron concentrations close to the Van Hove filling by 
means of the flow equation method. For if > — t/3 a d x 2_ y 2-w&ve Pomeranchuk instability dominates 
(apart from antiferromagnetism at small t'). At t' < —t/3 the leading instabilities are a gr-wave 
Pomeranchuk instability and p-wave particle-hole instability in the triplet channel at temperatures 
T < 0.15i, and an s*-magnetic phase for T > 0.15t; upon increasing the electron concentration the 
triplet analog of the flux phase occurs at low temperatures. Other weaker instabilities are found 
f*"*) , also. 

PACS numbers: 71.10.Fd, 71.27.+a, 74.20.-z, 74.20. Rp, 75.10.-b, 75.10.Lp 

^ , In recent years the two-dimensional (2D) Hubbard model has been used fJ, |) as the simplest model which maps the 
electron correlations in the copper-oxide planes of high-temperature superconductors since experimental data suggest 
that superconductivity in cuprates basically originates from the Cu02 layers ||. Although in the high-temperature 
cuprate superconductors electron-electron interactions are strong some important features of these systems (in par- 
ticular, antiferromagnetic and d-wave superconducting instabilities) are captured already by the 2D Hubbard model 
at weak to moderate Coulomb coupling. 

Apart from the antiferromagnetism and d x 2_ y 2-w&ve superconductivity mentioned above (for review see jl], 
and references therein), a few other instabilities related to symmetry-broken states @, ^, @, |[ |9[ [H], in the 2D 
Q t — t' Hubbard model with next-nearest-neighbor hopping t' have been reported recently. Specially, much interest 
O | of researchers has been attracted by the case when the Fermi surface passes through the saddle points of the single 
particle dispersion (Van Hove filling) . One of the instabilities found in such a case is a d-wave Pomeranchuk instability 
' breaking the tetragonal symmetry of the Fermi surface, i.e. a spontaneous deformation of the Fermi surface reducing 
^ . its symmetry to orthorhombic. It has been recently observed for small values of t' from renormalization group 
calculations by Halboth and Metzner They argued that the Pomeranchuk instability occurs more easily if the 
Fermi surface is close to the saddle points with a sizable t' (reducing nesting which leads to antiferromagnetism). 
However, within their technique it is difficult to compare the strength of the Fermi surface deformation with other 
instabilities and to conclude which one dominates. The authors of Ref. fl(J have investigated the interplay of e?-density 
■ wave Jl2| , |l3| and Fermi surface deformation tendencies with those towards d-wave pairing and antiferromagnetism by 
means of a similar temperature-flow renormalization group approach. They have found that the ei-wave Pomeranchuk 
instability never dominates in the 2D t — t' Hubbard model (even under the conditions mentioned above). 

On the other hand, Vollhardt et al. ju] showed that the i'-hopping term destroys the antiferromagnetic nesting 
instability at weak interactions in two and three dimensions, and supports the stabilization of metallic ferromagnetism 
in infinite dimensions away from half-filling. Therefore, one could expect also the stabilization of ferromagnetism by a 
sizable t' in two dimensions. Indeed, in the t — t' Hubbard model on a 2D square lattice at week to moderate Coulomb 
coupling, a projection quantum Monte Carlo calculation with 20 x 20 sites and the T-matrix technique j|] , a generalized 
random phase approximation including particle-particle scattering point towards a ferromagnetic ground state for 
large negative values of t'/t in a density range around the Van Hove filling. Similar tendencies have been found 
by the authors of Ref. || within the renormalization group and parquet approaches. Honerkamp and Salmhofer 
recently studied || the stability of this ferromagnetic region at finite temperatures by means of the temperature-flow 
' renormalization group technique. They have found that ferromagnetic instability is the leading one at t' < — 0.33t and 
Van Hove filling with critical temperatures depending on the value of t'. When the electron concentration is increased 
slightly above the Van Hove filling, the ferromagnetic tendencies get cut off at low temperatures and a triplet p-wave 
superconducting phase dominates. However, they did not consider the Pomeranchuk instability (which could have the 
most favorable conditions to occur) and other ones apart from antiferromagnetism, d- and p-wave superconductivity 
and ferromagnetism. 

Therefore, the investigation of interplay and rivalry between the Pomeranchuk instability and ferromagnetism, and 
other phases in the 2D t — t' Hubbard model at the Van Hove filling is a considerable task. We will consider the 
leading instabilities depending on the ratio U/t (in all papers cited above it was fixed). The main goal of this paper is 
such a study. We report also a few new instabilities in a range of electron concentration around the Van Hove filling. 
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We start from the Hamiltonian of the t — t' Hubbard model 
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(1) 




where £k is the Bloch electron energy with the momentum k, el (ck CT ) is the creation (annihilation) operator for the 
electrons with spin projection a G {|, J.}, U is the local Coulomb repulsion of two electrons of opposite spins, N is 
the number of lattice points, lattice spacingequals unity. 

By means of the flow equation method [p.5| the Hamiltonian is transformed into one of molecular-field type. This 
Hamiltonian is calculated in second order in the coupling U . Adopting the notations of Ref. jllj] , the expression 
for the free energy has the form: 



where the first term is the energy contribution and the second term is the entropy contribution, j3 = l/(fcsT), T 
is the temperature, t is the hopping integral of electrons between nearest neighbors of the lattice, Vk, q is effective 
second-order interaction (the factor U 2 /t has been extracted from it), /k is an entropy coefficient, and Ak are 
the order parameters. For example, Aker.-ker' = (cko-c-ko-'} = [0y)aa' A k + J2 a ( a v aa )< 7a '' ^k*> where a a is a Pauli 
spin matrix (a = x,y,z), and A k (A k a ) is the singlet (triplet) amplitude. An expression similar to Eq. (||) is 
obtained for particle-hole channels with the order parameters v instead of A. In this case, for example, we have 
Vka,k<7> = (c^Ck+Qa') = v^5 a . a < + Y, a "u* (^a) aa> with Q = {n , it) . All quantities of Eq. (|) are defined in Ref. @. 
For a square lattice the single particle dispersion has the form: 



The spectrum (||) contains Van Hove singularities in the density of states at the energy evh — 4t' related to the 
saddle points of the Fermi surface at k = (0, ±7r) and (±7r, 0). For t' = and half-filling the Fermi surface is nested 
£k+Q = — £k, which leads to an antiferromagnetic instability for U > 0. The nesting is removed for if /t ^ 0. 

We start from the symmetric state and investigate whether this state is stable against fluctuations of the order 
parameters A and v. As soon as a non-zero A or v yields a lower free energy in comparison with the symmetric state 
with all vanishing A and v, then the symmetric state is unstable and the system will approach a symmetry broken 
state. This indicates a phase transition. 

We perform numerical calculation on a square lattice with 24 x 24 points in the Brillouin zone for the various 
representations under the point group C^ v . The representations of the even-parity states are one-dimensional. We 
denote them by s + = s\, s_ = s xv i x t._ v %\, d + = d x 2_ y 2, d_ = d xy . The odd-parity representation is two-dimensional, 
here simply denoted by p. Initially, such numerical calculations have been performed in Refs. [O, but they were 
sensitive to the lattice size at low temperatures. Here we use an improved scheme (for details see Ref. @). 

We start from t' = and half-filling (n = 1) (see Fig. |l|). As expected in this case the leading instability is the 
antiferromagnetic one which disappears at the temperature T w O.Xt or doping S = n— 1 = 0.06. The next instability 
is a Pomeranchuk instability with <i a ,2_ y 2-wave symmetry in the singlet channel. The corresponding eigenvectors 
signals a deformation of the Fermi surface which breaks the point group symmetry of the square lattice. For negative 
t' > —t/3 the Pomeranchuk instability dominates at the Van Hove filling (see Fig. |2|). The d x 2_ y 2- wave Pomeranchuk 
instability competes with other instabilities at t' < —t/3, and it is not the leading one (Fig. ||). In agreement with the 
ideas of Ref. || the instability is mainly driven by a strong attractive interaction between particles on opposite corners 
of the Fermi surface near the saddle points and a repulsive interaction between particles on neighboring corners. To 
favor such a behavior we need a sizable t' reducing antiferromagnetic correlations. 

At half-filling and t' = the next instability is a particle-hole instability of singlet type with staggered p-wave 
symmetry. It yields fll|| a splitting into two bands and may lead to an energy gap in the charge excitations spectrum. 
Another mechanism for a charge gap formation has been proposed ]l8| , [To) recently in the 2D Hubbard model with t' = 
at weak coupling. The band splitting phase is developed in the region of electron concentration around half-filling, 
and is one of the strongest in that region. Then the superconducting d x 2_ y 2 instability follows which coincides with 
the d x 2_ y 2-w&ve staggered flux phase (the flux phase has been proposed by the authors of Ref. |l| and discussed 
recently in Refs. (l^, O, |2^]). Away from half-filling the degeneration disappears, and d-wave superconductivity 
dominates at low temperatures in certain regions of electron concentration around half-filling which depends on the 
value of t' ^ 0. Even large values of \t'\ do not destroy the dominant low-temperature behavior of d x 2_ y 2-w&ve 
superconductivity at doping fT^] . One phase may suppress another phase. To which extend two order parameters can 
coexist with each other is a question, which has to be investigated in the future. 
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2i(cos k x + cos k y ) — A£ cos k x cos k. 
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For t' = the singlet and triplet T c of the particle-hole instabilities with staggered symmetry of c? + wave character 
(that is the flux phase) are degenerate. If t' ^ they are different, and the triplet one is higher. Moreover, the triplet 
analog of flux phase dominates at low temperatures and t' — — 5t/12 when the electron concentration is slightly 
above the Van Hove filling (see Fig. |i|) in contrast to the results of Ref. H which point out the occurrence of triplet 
superconductivity with p-wave symmetry in this region. The triplet flux phase is also one of the leading instabilities 
for t' > —t/3 and certain region of electron concentrations (see Fig. ||). It has been considered by Nayak jL2| as a 
density wave order parameter potentially relevant to the cuprates, but to our knowledge a triplet version of the flux 
phase has not yet been observed in numerical solutions of the 2D t — t' Hubbard model. We shall discuss this state 
in more details elsewhere p"7[ . 

At t' = — 5t/12 a few other new instabilities appear to compete at the Van Hove filling and low temperatures 
(Fig. ||) in disagreement with the conclusions of Ref. || on the occurrence of ferromagnetism. The leading one is a 
Pomeranchuk instability in the s+ channel with g + = g x ' L + y 4 -6x 2 y 2 wave character (4 node lines in k-space). This 
phase occurs more easily if the electron concentration is close to or slightly smaller than the Van Hove filling (Fig. ||). 
It requests also sufficiently large absolute values of t'. When the electron concentration is decreased below the Van 
Hove density, a particle-hole instability of p-wave symmetry in triplet channel dominates at low temperatures (see 
Fig. |^), which gives rise to a phase of magnetic currents. In the d_ channel an z-wave (6 node lines in k-space) 
Pomeranchuk instability appears when electron concentration n is smaller or close to the Van Hove filling (Figs. 
It is a leading one at small values of the electron concentration |l7j . We observe (Fig. ||) in the s+ channel a g+ wave 
superconductivity below the Van Hove filling, but it requires strong coupling. 

Another situation occurs at the temperature region T > 0.15t. Here a particle-hole instability with s*-wave character 
(its order parameter changes sign close to the Fermi-edge) in the triplet channel dominates at the density range around 
the Van Hove filling (see Figs. [||5|). It is likely that the order parameter contributions do not compensate exactly, 
so that a weak ferromagnetism appears. When the electron concentration is increased above the Van Hove filling 
this instability does not become weaker, but the d x 2_ y 2 wave Pomeranchuk and the triplet flux phase instabilities are 
manifested stronger (they dominate at low temperatures). Then, this s*-magnetic phase disappears at sufficiently 
large values of electron concentration in comparison with the Van Hove filling, or smaller \t'\. 

From Figs. [|j5| one can see a reentrant behavior of the s*-magnetic phase in some region of the values U/t: 
approaching T c we get T l c from low temperatures and T c u from high temperatures at the same value of coupling U/t 
(T l c 7^ T"). This is a result of different behavior of T c (U/t) in two regimes. First regime occurs in the situation 
where the s*-magnetic instability dominates and the transition from a paramagnetic state to the s*-magnetic phase 
occurs directly without any intermediate phase, it corresponds to the temperatures T > 0.15i on Figs. | |. In this 
case the critical temperature increases with the increase of correlation strength U/t. Another regime occurs at the 
temperatures T < 0.15t. In this situation the critical temperature exhibits an anomalous behavior, it decreases with 
increasing the coupling U/t. The s*-magnetic phase is reduced. Since at lower temperatures only a smaller region in 
k-space around the Fermi-edge contributes, the sign-change of the order parameter reduces the effective interaction. 

In conclusion, we have presented a stability analysis of the 2D t — t' Hubbard model on a square lattice for various 
values of the next-nearest-neighbor hopping t' and electron concentrations close to the Van Hove filling. A surprising 
large number of phases has been observed. Some of them have an order parameter with many nodes in k-space. 
For t' > —t/3 the d x 2_ y 2-wave Pomeranchuk instability dominates. At t' < —t/3 the leading instabilities are a 
<7 + wave Pomeranchuk instability and p-wave particle-hole instability in triplet channel at temperatures T < 0.15t, 
and s*-magnetic phase for T > 0.15t; upon increasing the electron concentration the triplet flux phase occurs at 
low temperatures. The s*-magnetic phase is reduced strongly at low temperatures. We have found other weaker 
instabilities also. 
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FIG. 1: Temperature phase diagram of the 2D t — t Hubbard model for n = 1, t' = 0. Chemical potential /i = 0. SC stands 
for superconductivity, FP for flux phase, BS for band splitting, PI for Pomeranchuk instability, AF for antiferromagnetism. 




FIG. 2: Temperature phase diagram of the 2D t — t' Hubbard model for t' — —t/3, and n = 0.68 (the Van Hove filling). 
Chemical potential varies between fi/t = —(1.317 -r 1.339). TFP stands for triplet flux phase, M for magnetic particle-hole 
instability in triplet channel, other notations are the same as in Fig. Hi 
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FIG. 3: Temperature phase diagram of the 2D t — t Hubbard model for t' = — 5i/12, and n = 0.55 (the Van Hove filling 
Chemical potential varies between fi/t = —(1.666 -f- 1.632). Notations are the same as in Fig. |^. 
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FIG. 4: Temperature phase diagram of the 2D t — t' Hubbard model for t' = — 5t/12, and n = 0.60 (slightly above the Van 
Hove filling). Chemical potential varies between fi/t = —(1.621 -r 1.550). Notations are the same as in Fig. ^| 




FIG. 5: Temperature phase diagram of the 2D t — t' Hubbard model for t' = — 5t/12, and n = 0.50 (slightly below the Van 
Hove filling). Chemical potential varies between fi/t = —(1.709 -r 1.713). Notations are the same as in Fig. ^| 



